
Optimal Space Communications Techniques 
Final Report 

January 22,1973 - January 21, 1974 
Goddard Space Flight Center 
Greenbelt, Maryland 

under 

NASA Grant NGR 33-013-077 


COMMUNICATIONS SYSTEMS LABORATORY 
DEPARTMENT OF ELECTRICAL ENGINEERING 




THE CITY COLLEGE of 

THE CITY UNIVERSITY of NEW YORK 


(0ASA-C?~1 386C6) OPTIMAL SPACE 
COBMOSICAXICJiS TECHNIQUES Final Boport, 

22 Jan. 1573 - 21 Jan. 1974 (City Coll, 
of the City of t?ew York.) 60 p HC 
$ 6.00 CSCI 176 


G3/07 


S74-26664 ] 


Unclas 

41249 



Optimal Space Communications Techniques 
Final Report 

January 22, 1973 - January 21, 1974 
Goddard Space Flight Center 
Greenbelt, Maryland 
under 

NASA Grant NGR 33-013-077 


COMMUNICATIONS SYSTEMS LABORATORY 
DEPARTMENT OF ELECTRICAL ENGINEERING 


Donald L. Schilling 

Professor of Electrical Engineering 

Principal Investigator 



T able of Conte nts 


Introduction 

I. Digital Processing of Signals: Digital Multiplication using 
Delta Modulation 
if. New Areas of Research 
i'll. Doctoral Dissertation 
IV. Papers Published and Presented 



2 ) 

Introduction 

This final eport summarizes one aspect of the research sponsored by 
the National Aeronautics and Space Administration under NASA Grant 
NGR-33-0I3-077 for the period January 22, 1973 through January 21, 1974. 

The research supported by this grant encompasses the problems con- 
cerned with the Digital Processing of Signals. 

Part I of this report discusses digital multiplication of two waveforms 
using delta modulation.. Delta modulation is an A/D conversion technique 
gaining widespread use. However, when a digital signal is to be processed 
it is first converted to a PCM signal and then processed using one's com- 
plement or two's complement arithmetic. We are currently studying DM-PCM 
and PCMtDM converters in which the DM employed is adaptive. Our results 
of this study should be completed by 1975. 

It is important to note that the DM signal need not be converted to PCM 
prior to processing. The DM encoded signal can be processed digitally, 
directly in the DM format. The process of multiplication of two waveforms, 
each DM encoded, is discussed in this section. It is shown that while 
conventional multiplication of two N bit words requires N 2 complexity, 
multiplication using DM requires complexity which increases linearly 
with N. 

Bounds on the SNR resulting from this multiplication . pre determined and 
compared with the SNR obtained using standard multiplication techniques. 

A New Area of PLL research is discussed in Part II of this report. The 
PLL is one of the most often used systems in a communications system. 

It consists of a Phase Detector, Voltage Controlled Oscillator and a linear 
loop filter. The design of this filter is extremely important as the extra 
degrees of freedom given to the system by this filter results in the possi- 
bility of threshold extension increased pull-in r ange, decreased pul.l-;in 
time, etc. 

We are currently investigating PLL operation when the linear filter is 
replaced by a nonlinear digital processor. In particular we are consider- 
ing a processor which "looks " at the sign of the past phase errors and 
corrects the VCO accordingly. The algorithm employed is similar to the 
one used in the DM and we are able to show an equivalence between the 
PLL and the DM. 
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The research supported by this grant and its "sister grant 
NGR 33-013-063 has resulted in 1 PhD Dissertation (Part II) and the 
publication and presentation of severs, papers (Part III). 

Participating in this program were: 

Drs. J. Greco, I. Paz, W. Rosenberg and D. L. Schilling, 

and 

Messrs. J. LoCicero : D. Ucci, M. Steckman and N. Scheinberg. 


I. Digital Processing of Signals: Digit al Multiplication Using Delta Modulatio n 
Abstract 

We shall demonstrate that it is possible to multiply two signals that are 
digitally encoded with a Delta Modulator (DM) by operating on the incoming 
bit streams and employing only the standard digital manipulations. The 
resulting product error is investigated using signal statistics and for the 
case of constant inputs.. Signal -to-quantizati'on noise ratios (SNR) are 
obtained for constant inputs and various types of DM s. 


1) Traditional Digital Multiplication 

Generally digital multiplication is treated as a static operation; that is, 
two n-bit PCM words are either fed into a combinatoric circuit or into a 
preset read only memory (ROM) or a preset random access memory (RAM), 
The result is a 2 n-bit PCM word which is the product. If we wish to multi- 
ply two signals, both bandlimited to f m> then we must perform this static 
operation on the PCM words from each signal every seconds. This is 

because the product will be bandlimited to 2 f^ as we know from the 
convolution ■** multiplication theorem of Fourier analysis. 


The major objection to PCM multiplication is first, that it starts off fresh 
at each product operation and second, because of the combinatorics involved, 
the complexity involved and therefore the cost increases as the square of the 
numbers of bits that are used. We shall see that the DM multiplier not only 
operates dynamically with each product output depending on past inputs but 
its complexity varies linearly with the number of bits utlilized. 
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2) Digital Multiplication With Linear DM 

A linear DM, whose block diagram is shown in Figure 1, produces a 

signal estimate 

1-1 

x (i) = s 2 e (k), 
k=0 x 

where s = DM step size. 

Here we have assumed that x(t) is bandlimited to and is sampled for 

DM encoding at f >> i c 
s m 

Consider a second signal, y(t) 4 which is also bandlimited to snd 
which is also passed thru a linear DM. The estimate of y(t) is 

i- 1 

y (i) = s (j). 

We shall now form the product of the estimates and use this as an 
estimate of the product, that is, 

xy (i) ^xfi) y (i). 


(1) 


(?) 


(3) 


We can also write 


i-2 

x.i-1) = s 2 e (k) 
k=0 X 


and 

i-2 

y (i-1) = s £ 

1 J=0 


e x «) 


(4) 


(5) 


Combining equations (1), (2), (4), and (5) we form a recursive relationship; 


i-1 


i-1 


x (i-1) y (i-1) - s 2 

k=0 

e (k) 

X 

■ sE 
j=0 

e y 

i-2 


i-2 


- s 2 

e (k) 

■ s 2 

e (j) 

k=0 

X 

j=0 

y 


(6) 
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After some algebraic manipulations equation (6) reduces to 

i-1 

x (i) y (i) = x (i-1) y (i-1) ^s 2 e (i-1) S e (k) 

y k=0 x 

< 6 7 > 

+ s 2 e (i-1) ^ e (j) - s 2 e (i-1) e (i-1)* 
x ' j =0 y x y 

If we now introduce equation (3) into equation (7), the desired recursive 
relationship for the product is obtained: 

i-1 

xy (i) = xy (i-1) + s 2 e (i-1) £ e (k) 

y k=0 X (8) 

i-1 

+ s 2 e (i-1)^ e 0) s e x 0-“^) e v 

x j=o 7 y 

The block diagram realization of equation (8) is shown in Figure 2. It is 

* 2 

important to realize that in Figure 2 we use only scalers (s or s ), 
accumulators, delays, adders, and multiplication by e (k). Since e (k) 
is only +1 or -1, multiplication by e (k) is merely an exclusive-or 
operation. Thus we are using only the standard digital manipulations 
in this realization. We also see that this realization is independent of 
the number of bits used in the original DM. That is, if we increase the 
number of bits, we do not have to add new operations to this realization, 
but merely increase the capacity of the adders, delays, etc. 

3) Statistical Error Analysis 

For any DM system the error produced is the difference between .the 
actual input signal and the DM estimate signal after it has been filtered 
to eliminate the high frequency components introduced by the DM itself. 

Let us represent this error as: 

6 = X - X . 

X 


(9) 
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If we assume that x and x are jointly Gaussian, have zero means, 
and are highly correlated (as they should be because x is meant to be 
a good replica of x), then the joint probability density function is given 
as: 


p x, = 


exp 


2Tli 0 O^jT n 
X X / 1-P 3 


M-t— h — ] 


X X 


2(1- P 
' x x' 


( 10 ) 


y 


2 2 p xx. g(j P 

2__ a ' a 2 *. 

X XX x 


]] 


where 

O’ 2 = E (x 2 ) = Variance of x, 

X 

2 

o ~ - = E (it 2 ) = Variance ofx, 

P xx= E (xx ) = correlation cofficient, 
a 

X X 


Now we can apply the transformation (x, x) ■* (x, £ ) given by 

X 

e — x — x 
x 

in order to obtain the joint probability density function p ? e (a, £), which 

X' j X 

shall be used later to determine the product error. This type of transformation 
is well known [l j 9 and the joint probability density function is also jointly 
Gaussian. It is given as: 
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p la, P) = 

X 


exp { ' [ 2 (l-P* '") 1 • 

2tt a a /l- p 2 v x € ' . 

x c x e x 

x x 

2 P 

2 X6 


r * x r . p 


x e 


'X 


where 


2 _ 


E (e 2 ) = o 2 - 2 P - o cr - + a „ 2 

v X 7 X XX X X X 


2 

p - q - p ~ a o ^ xe 
x e x xxxx= x 

x a ffg a a 

x fc x x e 

x 


In a completely analogous manner, we can assume y and y are jointly Gaussian, 

have zero means and are highly correlated and express p * (c, 0) just like 

equation (10) except with o o * and p ~ replacing o , a ~ and P 

yy yy x x xx 

respectively. Then we can apply the transformation 


e = y - y 

y 

and obtain p , exactly like equation (11), again with a , a 

y "y y e y 

and p replacing o , o , and p respectively, 
ye x e x s 

y xx 

Now we can form the product error. 


€p=xy - xy ~ xy - x y . 


Using equations (9) and (12) in (13) we obtain 


- (* - V < y - V’ 

or 

e = x £ +ye e 

P y x x y 


(ii) 

j} 


(12) 


(13) 


(13a) 



8) 


Under the assumption that x and y are statistically independent, 


e 

P 


= 0 , 


(14) 


and the mean-square error is the same as the variance; that is, 


Var (e ) = « 2 * "j? e 2 +y^ e 1 + 2 xe ye - 2 xe x e 

' T\* r\ \r X v V 


X 


(15) 


- 2 y e v e * + e ‘ e *. 
Y x x y 


All of the terms above are well defined from the above assumed and transformed 
statistics . If we substitute the variances and correlation cbfficients for 
x, x, y^nd yinto equation (15), it becomes (see Appendix A); 

a 2 + Oa oa 2 - 2 p -P a a a - a a*. (16) 

y x y xxyyxxyy 



Now if we make use of the assumptions that 


a « a a , 
x x 

cr * a a , 
y y 

and, since we use the same DM for x and y, we can assume that 

p x x = p y £ = p » 
then equation (16) simplifies to 

e 2 = 2 o 2 o 2 (l- P 2 ) 

P x y ' ; ’ 


(17) 
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Equation (17) is plotted verses P in Figure 3, Here we see that the closer 
the correlation coefficient is to ± 1, the smaller the mean square error. 

Thus a measure of the quality of the product is the correlation coefficient 
between the signal and the estimate; i,e,, how well the estimate approxi- 
mates the original signal. 

4) Digital Multiplication Using Adaptive DM 

Realizing that the main disadvantage with linear DM is its fixed 
step size and therefore its lack of dynamic range, we would like to 
extend our operation of digital multiplication to signals that have been 
encoded with an adaptive DM. One type of adaptive DM is the enhanced 
Abate mode which is described, for an input signal x, by the following 
set of equations j 


x(k) = x(k-l) + S x (k). 


where 


S x (k) = | S x (k-1) | e x (k-1) + S e x (k-2), 

- step size at the k^ interval, 
e x (k) “ sgn (x (k) - x (k) ), 
and S = magnitude of the minimum step size. 

A 

We can also express the estimate, x (k.), non-recursively, as: 
k 

x (k) =.£ S (.i) . 

' ' 1=0 x v ' 

Likewise, a signal y applied to an enhanced Abate mode DM yields: 
y{k) = y(k-l) + S y (k). 


(18) 


(18a) 


(18b) 


(18c) 


( 19 ) 
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where 


(19a) 
(19b) 

and also 


S' y (k) = | S y (k-1) | e y (k-1) + S e y (k-2). 
e y (k) =- sgn (y (k) - y (k) ) , 


k 

y (k) =2 
j=0 


s y (j) . 


(19c) 


Now if we form the product estimate as the product of the signal estimates 
and apply equations (18) and (19), we obtain 


xy (k) * x(k) y (k) = (x(k-l) + S x (k) ) * (y (k-1) + S y (k) ) . 

If we expand equation (20) and employ equations (18c) and (19c), the 
following recursive relationship 1 is obtained: 

k-1 

xy (k) = xy (k-1) + S (k)’S. S (i) 

y i?=0 X 

‘ k-1 . 

+ S (k) £ S (j) + S (k) S (k). 
x v 1 y v 7 x ' ' y 


( 20 ) 


( 21 ) 


Equation (21) is not as easily realized as equation (8) was for the linear DM 
so we must expand the last three terms of it to obtain a usable realization. 

Starting with the last term of equation (21) and using equations (18a) 
and (19a) with k-1 replacing k, the result is: 
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S x (k) s y (k) = |S x (k-l) s y (k-l)| e x (k-l) e y (k-l) 

+ S[ |S x (k-l)|e x (k-l) e y (k-2)+ |S y (k-l)| e y (k-l) e x {k-2) ] (22) 

+ S e x (k-2) e y (k-2) . 

Equation (22) is a recursive relationship that is easily realizable since taking 
the magnitude of a quantity is a simple digital operation and the other operations 
are merely standard digital manipulations. 

The second and third terms of equation (21) appear to be a bit more difficult 
than the last term, but they can both be realized by introducing one clever 
substitution. Expressing the second and third terms of equation (21) in 
x (k) and y (k) notation, we obtain: 


k-1 

S (k)E S (i) = S (k) x(k-l) , 
y i=0 x w y 


(23) 


and 


k-1 


S (k) Ti SfJ) - S (k) y(k-l). 
X j=0 y 


(24) 


A recursive relationship can now be developed for S (k) x (k-1) by using 
equation (19a), equation (18) with k-1 replacing k, and the relationship that 
is always true for the step size of an enhanced Abate mode DM: 

S y (k-1) = | S y (k-1) ] e. y (k-2) (25) 

or 


I S y (k-ljj| = S y (k-1) e y (k-2) . 


; (26) 
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After the above substitutions and some manipulation, we realize the second 
term of equation (21) as: 


S (k)x(k-l) = S y (k-1) x(k-2) e y (k-l) e y (k-2) 

+ S x (k-1) S y (k-1) e y (k-l) e y (k-2) 

+ x(k-l) S e (k-2) . (27) 


Similarly a recursive relation for S (k) y (k-1) can be obtained by employing ^equation 

X 

(18a), equation (19) with k-1 replacing k, and the step size relationship; 

S x (k-1) = | S x (k-1) | e x (k-2) 
or 

l s x ( k-l) I = S x (k-1) e x (k-2) . 

The third term of equation (21) is thus realized as follows: 

S (k) y(k-l) = S (k-1) y(k-2) e (k-1) e (k-2) 

X X XX 

+ S y (k-1) S x (k-1) e x (k-l) e x (k-2) 

+ y(k-l) S e (k-2) . (30) 

A 


( 2 , 8 ) 

(29) 


Observing equation (27) and equation (30) we see that 

S x (k-1) S y (k-1) e y (k-l) e y (k-2) and S y (k-1) S x (k-1) e x (k-l) e x (k-2) 



are needed for these realization. However, we have already obtained 
g x (k) S y (k) recursively via equation (22); so we merely need to delay 
S x (k) S y (k) and then multiply it by e^ (k- 1 ) e^ (k-2) and e x (k-1) 
e (k— 2) respectively. This then completes our realization. The block 

X 

diagram for the entire adaptive digital multiplier is shown in 
Figures 4, 4a, 4a (i), 4a (ii), 4b and 4c. 

5) Sighal-To- Quantization Noise Ratio For Constant Inputs 

Let us first consider the linear DM responding to an input x which 
is a constant. In order to obtain the quantization noise, we must realize 
that it is introduced via the A/D converter and therefore we must 
differentiate between the sampled value of x, x (k), and the sampled 
and A/D converted (or quantized) value of x, x^(k), The input-output 
quantization relationship is shown in Figure 5. Thus 



x (k) = mS 

q 

where 

m = an integer, 

and 

S = DM step size. 

if 

(mS - }S) <x(k) < (mS + |S) . 


In Figure 6 we show the response of a linear DM to a constant input. It 
is important to note that the arithmetic used in the digital DM is offset 
binary and one characteristic of offset binary is that the difference 
between two identical numbers is a "zero minus". This means that 
when x (k) = x (k), e (k) will be -1, and we will always underestimate 
our signal. Thus the linear DM is a biased estimator when using offset 
binary arithmetic. 

As we have done before, let us assume that the input x is Gaussian 
with probability density function: 



14) 


P x< a) 


1 exp {-a /2a^ ) . 
/2tt a 2 

X 


(31) 


If we examine xwhen it has reached steady state, we see that it is 

repetitive and takes on values (x . -s) and x as shown in regions Rj 

q Q 

and R 2 in Figure 6. Now if we also assume that S is sufficiently small, 
then the sampled input x (k) is equally likely to occur in the interval 
(x - is , x + is) . Therefore, the steady state error 

q q 


s (k) = x(k) - x(k) 

X 


(32) 


will take on a uniform probability density function • 

To determine P (a) we use the law of total probability as 

e x 

applied to probability density functions: 

P (or) = -p (or | x e Rj) P(Ri) + P (a | x e R 2 ) P(R 2 ) • (33) 

€ x E x € x 

It is reasonable to conclude that since we are seeking the steady 
state error that regions R x and R 2 are equally likely when x has reached 
steady state. Thus 

P(Rj) = P(R 2 ) = i . (33a) 

Returning to the conditional densities in equation (33) and the previous 
assumption that S is sufficiently small so that x (k) is equally 
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likely for the interval 
see that: 

« X <J-* S - V 

|S ) it is not difficult to 

P e (a 

X 

| X e R x ) 

■ 1 
s 

|S < a < 3S/2 , 



= 0 

elsewhere, 

and 




p c (a 

X 

[ x e R 2 ) 

- 1 
s 

— "2 S ^ ct ^ j?S , 



* 0 

elsewhere. 

Combining equations (33) thru (33c), we 

obtain: 

p (a) 

= 1 

s 

-|S < ex <3S/2 , 

e 

X 

2S 



* 0 

9 

elsewhere. 


(33b) 


(33c) 


(34) 


Now we see that p (a) is uniformly distributed over the interval 

£ 

( -|S , 3S/2) , and we can prove that the linear DM is a biased 

estimator by showing that e =f 0 • Instead we can calculate 

X 

oo 

€ — f a p (o') da , 

x J e 

x 


= iS . (35) 

Likewise we can calculate the second moment of’ e and the variance of e ; 

X x 

oo 

e 2 = [ a 2 p (a) da , 

x J € 

-OD x 

e 2 = 7S 2 /12 
x ' 


(35a) 
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Var (e ) = e 
x x 


€ 2 , 
X 


Var (® x ) = S ' 73 . 


Referring to equation (31), the input signal power is: 


/ o' 2 P (a) do- , 


x = c 

X 


Thus we can form a signal-to-quantization noise ratio for a constant input: 


A — 7 

SNR = x 2 

Var ( e ) 
v x 


Analogous to equation (13a), we can form the product error as: 


e - x e + y e - e e , 
p y x x y 


where e and e now have probability density functions which include 
x y 

the A/D quantization [i.e., equation (34) ]. Assuming that x and y are 

statistically independent and p (») = p (a) - equation (31), we obtain: 

x y 


e = - e c = - S z /4 , 

p x y ' 


e z = x 2 e 7 +■ "y 2 " e ^ + 2x e ye 
p y X X y 


-2x e e ~ 2y e e + e e ^ 
x y y x x y 



17 ) 


To completely evaluate equation (40), we must know the joint probability 

density functions p (a.jS) and p (a,&), so that x e and y^ e 

x, e x v ,H} y; e y Y Y 

can be determined. However we already know that the marginal densities 
are Gaussian ( x and y ) and uniform ( and e y )• Also the marginal 

densities must satisfy 

00 

p x («) * J* P x e 

1 x 

and 

CO 

p e ^ = I P xe (*•£) da * 
x 1 x 

With the previously specified marginal densities we conclude that 

P x e (<*£) = 1 exp (V/2 ct x 2 ) , 

x 2S / 2rr a 2 


-i |S < 0 < 3S/2 

V c ♦ 


This means that 

p x e M) = P x (*) P e 0) * 

x x 

or that x and e are statistically independent. Of course the same argument 
applies for y and e . Evaluating equation (40), we see that: 


e 2 = 7 e 2 + ^ e 2 + e 2 e 2 , 

P y x x y 


,7S 2 <J 2 ^ 7S 2 a 2 49 S 4 

G “ x 4* y + 

i mtfi r iai f i M ii -> ■. * .s ■ ■ 

10 10 1 / 1/1 


(41 ) 


(41a ) 


( 41b ) 


(41c ) 


( 40a ) 


12 


12 


144 


( 40b ) 
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Now we can evaluate the variance of e and use this as our quantization 

P 

product noise: 


Var (e ) = e - e , 

P P P 


Var (e ) = 7S 2 (a 2 + a 2 ) + 5S 2 

P ~U X y TT 


( 40c ) 


Defining the product signal-to-quantization noise ratio as 


SNR p = ( x y ) 3 


Var <e ) 
v p' 


we obtain: 


SNR 

- 


36 a 2 a 2 


-iiS^iT*- 2 - '*J + Tos 4 

v x y 7 


(42 ) 


(42a ) 


As a final comment, it is to be noted that the above SNR reflects performance 

P 

before the final low pass filter where out of band noise is eliminated. Currently, 

investigations are being made to determine the performance after filtering. 

Now we will repeat the above for the case of an adaptive DM operating in 

the enhanced Abate mode [ equations <(18X,r (I&p).}.' It has been shown /by Songi 

Garodnick and Schilling [2] that in this mode of operation all steady state 

responses take on a "general error pattern". The general error pattern as 

shown in Figure 7, is the steady state response xto a constant input signal 

x, which has been quantized to x , In the general error pattern, n is a non- 

Q 

negative integer, or 

n = 0, 1, 2, 3, . . . N 
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P g (aj n = y , xe Rj) = 1/S , (Y + i)S < a < ( Y + 3/2)3 , 

x 

— 0 , elsewhere , ( 43b ) 

p (a j n = y, xeR 2 ) = 1/S , yS < <2 < 3S/2 , 

6 

x 

= 0 , elsewhere , ( 43c ) 

P (a- 1 n - y, xeR 3 ) = 1/S -(Y+ £)S < * <-(Y - i)S 

X 

= 0 , elsewhere , ( 43d ) 

P. (a J n = Y . x e R 4 ) = 1/S » - |S ' u < |S 

s 

X 

= 0 , elsewhere . ( 43e ) 
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Combining equations (43) to (43e), we obtain: 


P e (a | n = y ) 

X 


1/4S , (Y+ i)S <a <(Y+ 3/2)S , 

1/4S , iS <a < 3 S / 2 , 

1 /4S , ~(Y + y)S < a <-(Y _ i)S , 

1/4S , -|S<Q-<iS , 


= 0 


elsewhere . 


We also notice that the probability density function of n, p (y ) , 

n 

is discrete with values at y = °» 1. 2 N which we shall represent 

as P ( y) , where 
rf 

N 

£ P (Y) = 1 . 

n n 

Y=0 


To obtain the desired p g (o'), we employ 

x 


p e <«) - 

x 


N 

E P s (a | n « Y) P n (Y) • 
Y^ x 


The result is as follows: 


[due to Ri ] : p (a) = P (0)/4S , i$. < a <3S/2 , 

£ n 

x 

= P n (1)/4S , 3S/2 < a < 5S/2 , 

= P (2)/4S , 5S/2 <a < 7S/2 , 

4 

8 

= P n (N)/4S , (N + i)S <a < (N + 3/2)S , 


[due to R 2 ] : 


P e (a) - 1/4S , is <.« OS/2 , 

X 


(43f ) 


(44 ) 


(45 ) 
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[ due to Rg] : 


p e <«> 

X 


P n (N)/4S , -(N + i)S <a <-(N - t)S , 

(N -1)/4S , -(N - j)S < a <-(N - 3/2)S , 


= P n (1)/4S 
= P n (0)/4S 


-3S/2 <a<- k S , 
-jS < O' < '2 S , 


[ due to R4] : p ( a ) = 1/4S , ~|S < a <|S . 

€ 

X 

Equation (46) is shown graphically in Figure 8. We see that this DM also 
produces a biased estimate because 



which can easily be verified by observing that p fa), as seen in 

e 

x 

Figure 8, is symmetric about a = |S. Using equation (46), we can also 

calculate e (see Appendix B) and then the variance of e : 
x x 

IT 2 = _sl (6 n 5 + 6 ri + 7) , 

X 12 

Var (e^) = _sL • (3 n 2 " + 3 n + 2) . 


Now we obtain a s ignal-to-quantization noise ratio for a constant input: 


SNR 


_ 

Var (e x ) 


6 a 2 

x 

S‘ (3 n 5 " + 3 n + 2) 


If we proceed to apply the same analysis as was done in equations 
(38) thru (42), we can obtain a product signal-to-quantization noise 
ratio for a constant, input with this type of adaptive DM. The statistics 


(46 ) 
(46a ) 

( 46b ) 
( 46c ) 

( 46d ) 
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that we use are: 


2 S , 


(47 ) 


e = e ‘ 
k y 


= _S1_ (6 r?" + 6 n + 7) 


(47a ) 


Applying equations (39) and (40a) : 


P " - « X E y = - S74 


( 48 ) 


e 2 = x 2 e + y 7 " e 2 + e ? e 7 , 

P y x x y 


2 \ /c —2 


S_(o ‘ + (J 1 (6n z + 6 n + 7) + _S^_ (6 n' + 6n + 7)% (48a) 


It is significant to recall at this point that in order to obtain equation (40a) , 
x and e had to be statistically independent. Although at first glance 

A 

it appears that p g (<*) {equation (46)]is dependent upon x, p (a) really 
x x 

depends on p (o) and as long as p (a) is specified, then p ( a ) is 

X 

independent of the actual value of x. Thus equation (40a) is applicable in 

this case and equation (48:a) is valid. 

The conclusion is to now obtain the variance of e and the product 

P 

signal -to-quantization noise ratio: 


Var (S ) - _§1 _ (cr ‘ + a 2 ) (6 7 + 6 n + 7) + S 3 [ (6 7 + 6 n + 7) 2 -91 
P 12 7 144 

( 48b ) 
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SNR = jxyf_ 
P Var(e p ) 


SNR 

P 


576 a 2 a 2 

2 X : 

12S 2 (a 2 + a 2 ) (6^? + 6 n + 7) + S 4 [(6 7 + 6 n + 7) 2 -91 
v x y ' 


(49 ) 


As with the linear DM, investigations are currently being made to 
determine performance after filtering and comparison made with computer 
simulation results. 

6) Conclusion 

As can be seen from the previous five sections, many facets of the 
digital multiplication using delta modulation problem are being investi- 
gated. There are many more inquires that must be made. Among the 
most pressing are a computer simulation and testing of the adaptive DM 
multiplier, a determination of exactly how much real time storage is 
needed, and analysis of performance after final low pass filtering. When 
these items are completed, digital multiplication using delta modulation 
can become an effective operation in digital processing of signals. 
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APPENDIX 


A. Derivation of Equation (16) : 
Starting with equation (15): 


e 2 = e 7 + e * + 2 xe ye - 2 xe e 5 
p y x x y x y 


-2 ye e . + e 2 e 2 

y x x y 


= x 2 e 2 + y 2 e 2 + 2 xe (ye - e" 3 ) + e 2 (e T - 2 ye ) , 

y x x ' y y ' x ' y y 


if we use e and xe from equation (11) and the analogous forms for e 

XX y 

and ye , the result is: 

y 


e'" 2 = a 2 (a 2 - 2 p « <j a « 
P x y yy y y 


cr ?) + a 2 (a 2 - 2 p a o a a , Oa 2 } 
Y y x xx x x + x ' 


+ 2 (a 2 - p a a a a) (p a ' u a - a a 2 ) 

X XX X X 7 ' y y y y y ; 


+ (a - 2 p A o a A + a A 2 ) (a A 2 - a ,. 2 ) 
x xx x x x ' v y y 


If we now exp or. d the above and cancel common terms, the final form 
becomes equation (16) - 


eT = a 2 , 2 + a a 2 . 

P x y x 


2pAp aO CaC 7 a a 
XX yy x X y y 
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B. Derivation of Equation f46b): 

Since p to) is uniform for each of 2N intervals, if we let P T 
e ' ’ I 

x 

represent the value in interval I, then the contribution to e for 
interval I is given as: 

< e T>i = h ° 2 p i 6a - p i “ s / 3 1 1 • 

The total is obtained by summing over all intervals . 



N 

£ 

i=0 


{ (P n (i)/4S ) (tf 3 /3) 


(i + 3/2)S 
(i + 2 )S 




N 

£ 

i=0 


r 7 


) (- 3 /3) 


" (i - l)S 
- (i + i)S 


+ ( 1/4 s ) 


33/2 

-Is 
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B. Derivation of Equation (46b); - continued 
Inserting the limits and canceling terms, we obtain: 



x 


N 

E 

i=0 

N 

E 

i~0 


is 2 


{ ( P n (i)S 2 /12 ) [ (i + 3/2) 3 - (i - I) 3 ] } + 7S 2 /24 


| ( P n (i)S 2 /l 2 ) (6 i 2 + 6 i + 7/2) j + 7S 2 /24 , 


N N N 

E i 2 P (i) + |S 2 E i P (i) + (7 S z /24) E P (i) + 
i=0 n i=0 n i=0 n 


= |S 2 n 2 " + IS 2 n + 7S Z /12 . 


Factoring the common terms yields equation (46b): 



x 


S 2 ( 6 n 2 + 6 n + 7 ) . 

12 


7S 2 /24 , 
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II. New Area of Research 


A Digital Phase Locked Loop With Nonlinear Processor 

The Phase Locked Loop (PLL) is a nonlinear control system which has been 
under study by many investigators in the past few years as evidenced by the 
literature that has been published on the subject. Its applications range from 
bit synchronization to carrier tracking to FM demodulation. 

Until recently most of the emphasis has been on analog phase locked 

loops as shown in Figure 1. This device consists of a phase detector, (PD) » 

a filter, and a voltage controlled oscillator (VCO). The VCO is sometimes 

called a slave oscillator since, in steady state, its average frequency is 

that of the incoming signal w . 

o 

The principle of operation is as follows: the phase of the VCO is an 
estimate of the phase of the incoming signal. This incoming signal plus 
noise and the VCO output are inputs to the PD, The output of the PD, 
t (t) is a function of the phase error, e (t) = V m (t) - ® (t). This function 

'I' (t) = f ( e (t) ), is then filtered to form V^ (t) which is the demodulated 
output voltage. Since V^ (t) is proportional to the VCO frequency, 9 ^ (t)^ 
we can write 

9 V < £ > = G vco /. £ <% ( k > - e v (M ; • h Ct-M 

where h (t) is the inverse Laplace transform of H(s) the filter transform, 

(t) is the modulated phase, 9^ (t) is the VCO phase estimate, and f (x) 
is the PD function. Thus it is seen that in the PLL, the error signal is 
niter sd to provide the necessary correction before it is fed back through 
the VCO to the PD. 

Now ,hovyever, with an emphasis toward digital processing, investigation 
into various types of Digital Phase Locked Loops (DPLL) has been initiated. 

In a typical DPLL configuration as shown in Figure 2 we see that the incoming 
signal is first sampled and held and then A/D converted. This digital input 
signal is now digitally phase detected and filtered. The digital filter seems 
to smooth the error signal t (k) = f (cp^ (k) - 6 (k) ) . 
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In most PLL, the nonlinearity arises in the PD and the loop processor is 
a linear filter. However, there may exist advantages in using a nonlinear 
processor in a loop. 

In particular, we are currently investigating the use of various algorithms 
used in digital Delta Modulation (DM) schemes. Consider, for example the 
DPLL system shown in Figure 3.. Here the error signal 'if (k) is processed by 
the nonlinear processor such that 



e(k) = sgn C ij; (k) ) 

(2a) 

and 

k-1 k-1 

v n ( k ) = A 2 e(i) = A E sgn [| (i) ] , 
i=0 0 i=0 

(2b) 


where A^ is the step size of the DM. Thus the DPLL response equation is 
given by the nonlinear recursive difference equation 


V k+ 1} " e v (k) = G VCO Sgn C + < k > 


(3a) 


where 9^ (m) is the estimate of the incoming modulating signal at the m 
sampling instant and G. ~ is a constant gain. By letting the derivative at 
the k instant be equal to a difference i.e., 


x(k.) = [x(k) - x(k - 1) ] / AT, 


(3b) 


we obtain the following: 


e (k + 1 ) ■ s' (-) +• € (k - 1) = G vco sgn [ f (k) , + £ '4) m (k+l) - 

2 V Jk) + v 1 ^ (Sc) 

It is seen that this DPLL system can be considered as a second order 
PLL using a digital filter employing 1-bit interval arithmetic. As such it 
is characterized by a nonlinear difference equation. This system is obtained 
when a processor used in a linear delta modulator is inserted in the loop. 

The nonlinearity is the sgn function which results in a binary phase detector. 
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As another means of nonlinear processing, the Song and Abate mode 
algorithms for Adaptive Delta Modulators are chosen. 

The generalized equations for these modes are as follows: 

A) Song Mode 


V D (k+l) = V D (k) + AV D (k+l) 

AV D (k) = a I'AV D (k-'J) | e(k-l) + J3 | AV D (k-l) | e(k-2) (4b) 


e(k) = sgn [ r|r (k) ] . (4°) 

Here A V D (k) is the adaptive DM step size and a , and 0 are constants. 
Appropriate scaling can be introduced at the e(k)’s. Experiment ally and 
theoretically it has been determined that a = 1, and 0 = are optimum 
values as far as performance and hardware implementation (cost). 

The DPLL response equation of this system is as follows: 

0 v (k + 1) - 2 0 v (k) + 6 v (k - 1) = g d { | 8 v (k) - 20 v (k-l) +9 y (k-2) | * 

[ e(k-l) + \ e(k-2) J } , (4d) 

where g^ is a scaling factor. 

This type of DM was found to work well with Video signals and 
therefore application of this loop to video transmission bears 
investigation. 

In the Abate mode the following equations govern the system: 


(5a) 

(5b) 
(5c) 

In the above AV q is the minimum value of step size. The equation 
of response for the DPLL in this case is: 


V D (k) = V D (k " 1} + A V D (k) 

AV D (k) = | AV D (k - 1) | e(k - 1) + A V q e(k - ; 2) 

e (k) = sgn [ i|r (k) ] . 
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e v (k+ 1) - 2 e v (k) + e v (k - 1 ) = { | e v (k) - 2 0 V (k-1) + e v (k-2) | . 

e(k-l) + G VC o A V (k_2) } • ( 5 d) 


This algor ii.hmhas been successful for voice and so this loop bears 
investigation for audio application. 

There is a s >ni]h.iiy ?o these equations. Techniques to solve 
the above nonlinear difference equations are now under investigation. 
Note also that these equations are for signals with no noise present. 
The response of these PLL in the presence of noise will also be 
investigated and performance on a SNR basis will be evaluated and 
compared to other present day systems. 

Pull-in time and lock -on range will also be determined and an 
attempt made to minimize the pull-in time. 
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AM ALL DIGITAL PHASE-LOCKED LOOP FOR FM DEMODULATION 
John Greco and Donald L. Schilling 
Department of Electrical Engineering 
City College of The City University of New York' * 

New York, New York 10031 


Abstract 

An all digital phase-locked loop for FM demodula- 
tion Is presented. The unit operates as a real time 
special purpose digital computer and employs a square 
wave voltage controlled oscillator. Design procedures 
are given for a first, second,' and third order loop; the 
design reflects the influence of the square wave oscilla- 
tor as well as quantization limitations. In an attempt to 
obtain information about the threshold of the digital 1 
phase-locked loop, the response to artificial input noise 
spikes is examined. 

1. Introdu ction 

The block diagram of the digital phaso-locked loop 
(DPLL) Is shown in Fig. K All signals to the right of the 
A/D convertor are binary words and all computations 
within the DELL nro digital. Tho digital Cil tor is oithor 
a proportion*! I path, a proportional plus integral path, or 
a proportion vil plus integral plus double integral path 
yielding the first, second, or third DPLL respectively. 

To simplify the implementation, tho filter gains are re- 
stricted to be 1/2 , with N an integer, so that coeffi- 
cient multiplication is reduced to shifting the binary 
word. To avoid a binary multiplication of the input xj, 
and VCO output w^ at the phase detector, the digital 
VCO waveform is a square wave having values *1, The 
multiplication is then reduced to a simple logic opera- 
tion, An algorithm is developed (I) to determine the 
correct output of the digital VCO and an implicit VCO 
(Jain is introduced (1) : Gy CO = TT 2 w /5 , N » integer. 

2. Dig i la 1 Pi i a s e - Locke d Loop E q u ati o n 

To avoid distortion in the sampled incoming FM sig- 
nal, the sampling frequency*-^, is chosen according, to 

* f s * 2rn B , (la) 

l V f o “ ( lb ) 

where B ~ IF bandwidth 


Vi = v 2G cos + v Sq {k k + v < 4 > 

where G ~ loop gain. This nonlinear difference equation 
is extremely difficult to analyze and so a linearized 
model is introduced. 

3, Linearized Model 

The function Sq (♦) contains odd harmonics and tho 
product of input and square wave produces harmonics 
at 0, fy/2m, 2f s /2m, * * , f Nf 0 / 2m, - ♦ * Hz. Of course* 
the zero harmonic is tho only useful term as it contains 
the phase error information. Honco, wo would like to 
have the other harmonics fall outside tho DPLL hand- 
width*, But this is impossible as tho (2m)- harmonic in 
at f s Hz which is equivalent to 0 Hz* That is, tho ^las- 
ing produced by sampling introduces a term at 0 Hz, 

This torm has amplitude art tho ordor of l /Am, and do it 
appears that wo should choose m largo. However, choos 
ing m large results in tho harmonic at f /2'm being in- 
troduced into the DPLL bandwidth. The constraint wo 
impose is to have this harmonic fall outside the DPLL 
bandwidth. If the input frequency deviation is £f p the 
bandwidth of this harmonic is approximately 4 A£„ and 
so the constraint is 

IJ 2 m - 2 Af 

with - DPLL bandwidth. 

If we can choose m ^3, the (2m) tb harmonic will be 
at least 20 dB below tho fundamental and its contribution 
to tho output and VCO phase can be neglected. 

With Eg (5) satisfied wo introduce the linearized 
model of the DPLL by using the VCO fundamental to goner 
ate the phase error. This fundamental has amplitude 
4/n, and assuming |e,. j « n/2, we arrive at the linear!- 
2erJ model shown In Fig. 2, where G vro = implicit VCO 
gain* 

4- Phase Error Ccmtratnt 


m £ 1 

n ~ integer 

f 0 ” carrier frequency*. 

The VCO output is given by 

^" Sq < Ie sr +$k) < 2 > 

where <? = VCO phase, 

- , . J +1, 0 & X <TT 

faq * A ' “ Ul, n fix <2tr. 

end Sq (x) is periodic with period 2*1 The DPLL output 
V' K is the derivative of the VGO phase in our digital 
scheme the derivative is computed eg the difference f 




( 3 ) 


* .. uuusuu ijc; omcui so uicai we Opera 

on the linear portion of the phase characteristic: i.e., si 
e k G k“ <2rror in this approximation is referred to a 
harmonic distortion. However, e )c is represented by a 
finite number o£ bits and a small will be lost in the 
quantization noise* Hence, an optimum phase error exit 
for which signal -to- harmonic distortion and signal -to- 
quani.izat.ion noise are equal. These quantities are com- 
puted (assuming e k uniformly distributed over its range) 
and plotted again st (e^) for id-bit quantization and 
1 2 -bit quantization in Fig* 3. The inter sec lions give the 
optimum value of fe , a * 1 . • * j' 

1 > - f 1.1 cur 

Number oi Eft# 




10 * 

12. 


nr ix 


(volts). 


Zb 


0. 

0.23 


0. 


First Order 


Fin ally, the output y Jf . is determined from the phase error 

signal by the digital filter characteristic*. For the 

first order DPLL, y*, ^ ^ 

* ** St c ir ana combining Eqs {2} and {3 ) f 

wo obtain tho difference equation for the VCO phauej 


frequency offset o£ -f produces m oh&'vo 

* w a • i . *■ 


2Tr &z/t s 


m 


7:hl - D!>LL is constructed using l C-blt arlthmatlaj ’thero- 


4.3-3? 


I 




fore 


2TT t f./f 


(V S pike =2TT{ "-' C ° S kn/K) 


( 14 ) 


<0.35 


The DPLL bandwidth Bj, 4s given approximately by 


b l 


•' s ?i G 


where the approximation is valid for ffG << l. Utilizing 
Eq, (9) in Eq. (5), 


2 m 


- 2 Af 2:f ™ G 
s n a 


Combining with Eq, (7) yields the design equation 


m 


11.28 Af 


The DTL and TTL logic employed necessitated the value 
f s « 50 kH?, to provide a sufficient computation internal., 
Choosing Af a GOO Hz we obtain m £>7.4« Wo shall uso 
m - 8 (the VCD algorithm is simplified when m is a pow- 
er of 2). Wo further obiain 1 from- Eq •(7) G ^ .214 and • 

Bj 2.14 kHz. The choice m - 8 invalidates Eq (5); we 
shall choose 

G - 0*157 » rr/5 . 2 2 

and allow (e^) « 0,40. Then Bj j *= 1.57 kHz (the approx! 

motion of Eq" fbf'is conservative; the actual bandwidth 
is 1*8 kHz) and Eq, (5} is satisfied* 

Summarizing, the parameters for the first order DPLL 

arei 

f ^ 50 kHz 
s 

Af * 600 He 
G “ 0*157 * tt/5 < 2 * 

,. 6 V D esign the Seco n d Order DPLL 

The digital filter is augmented to a proportional plus 
integral filter having transfer function H{&} given by 

H(«> = g s g 7 , -j^~=T (42) 

where gj, = proportion ai path gain 
- integral path gain* 

We shall use the same sampling frequency and frequency 
deviation computed for the first order DPLL* 

The second DPLL tracks a frequency offset with zero 
phase error* Therefore we consider, sinusoidal modula- 
tions cp = p sin k 2TTf m /f s . If f m << f s , the phase 
v error amplitude is 


The spike duration, K/f s , is chosen as the reciprocal of 

m the IF bandwidth; this is the fastest spike possible. 

This spike is superimposed on constant or sinusoidal 
modulation, producing a positive spike when the input 
' frequency is at the left extreme of the IF bandwidth. 

The nonlinear difference equation is solved on a com- 
puter for the VCO phase and the solution is examined 
to determine whether or not the loop follows the spike. 
Note that the linearized model is not valid when a spike 

(9) appears as the phase error becomes large. Also note 
that the carrier amplitude remains constant during the 
spike; this represents a worst case as in actuality the 
amplitude decreases. 

(10) The results are displayed in Fig, 4, whore the spike 
responses are displayed as a function of loop gains. 

Fig. 4 (a) is the case of the spike superimposed upon an 
input frequency deviation of GOO Hz; Fig. -4 .(b) is for 
sinusoidal modulation with f m = 200 Hz and fi » 3. They 
clearly show that m = 8 is unsatisfactory as the loop 
becomes unstable for almost all values of G\* * The case 
m - 4 is not n\uch better. If we decrease the integral 
gain to n / 5 ° 2 ^ (and consequently increase the phase 
error) then we can choose or tt/ 5,2^ or 

f 1 *) n/5.2 6 . The final choice depends on satisfying Eq. (5) 

-and also on. the linearized in put- output loop transfer 
function. As we are interested in FM demodulation! tho 
DPLL transfer function should be as flat as possible out 
to f m . Examing these conditions leads to the choice 
Gj = n/5-2 4 . 

Summarizing, the second order DPLL gains are 


G^tt/ 5.2 4 G 2 =Tt/i>.2 7 


7, Design of tha Third Order DF-X 

A double integral filter is added to the previous 
filter of Eq. (12); 


H(z) = in + ga 


1 


1 - s“ l 


+ 3$ (' 


1 “Z 4 


1 .3 
~i> 


(15) 


yielding the third order DPLL, For sinusoidal modulation, 
the phase error amplitude is approximately given by 


\ 


(e, ) ( 2rr W f s ) 2^ Af /f 

v fc'max -r ' s 


(16) 


{©.) - - 2 --Mls 2TT f /f 

' Jr max Gs nr n 


(13) - 


where G% = gain of the integral loop. Choosing f m ** 

200 Hz (jS - 3) w© obtain from the phase error restriction. 
a 2 .0055. We choose intlally G a ~ *009818 

Now we have n; and Gj. at out. disposal to meet Eq,(D)« 
But we wish to achieve more than simply satisfying this 
• equation— we seek n second order DPLL which provides 
threshold improvement over the first order DPLL, To gain 
insight into tho loop's behavior near threshold, we in- 
troduce. an art file si spike to the DPLL and observe the 
response (VCO phase). Obviously s it the VCO phase 
follows the Input spike* the spike is reproduced at l he 
output. 

The mod e l u s e d for t he s plks 1 s a s Liu t old a 1 i n c re as e 
of radians in the input phi} so; 


' G, 

w here G « = g a 1 n of t he d ou b). e i n to gral path, I m no s l rig 
the phase error restriction yields (using Af - 600 Hz 
a nd f » 200 He } fh00 0132. We choo s e 

G 3 - 0,000154 - tt and in - 4, The values of 

Gi and Gjj, are chosen from th spike response and line- 
arized loop characteristic. The spike responses illus- 
trated in Fig* (5) show that there exist several pairs of 
gains O u G* for which the third, order DPLL suppresses 
the input spike, both for constant and sinusoidal modu- 
lation, To narrow the choice, a spike lasting 
2 / (IF bandwidth) seconds is introduced and the 
final choice is 


G» - n/5* 


G;> » VT/S-S 8 


G g = n/5 *2 


12 


(17) 


These gain a produce a linearized characteristic which 
is flat ivithin 0.5 dB to 200 Hz and has a 7 30 Hz band- 
w id t ) U thereby satis f y J.ng Eq, (5), 
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8. _ Conclusions 


An all digital phase-locked loop has been presented 
and a design procedure for a first, second, end third 
order Joop is developed. The procedure involves quanti- 
zation effects and response to artificial Input noise spikes. 
Experimental results based on this design will bo present- 
ed. 
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Fig. 4a. Second order DPLL spike response; the 
spike is superimposed on c. 600 Hz 
frequency offset* 



He, 4b. Second order DPLL spike response: the 
spike is superimposed on sinusoidal 
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OVERSHOOT SUPPRESSION IN ADAPTIVE DELTA MODULATOR 
LINKS FOR VIDEO TRANSMISSION 

by 


L. Weiss, I. Paz, D. L. Schilling 
Department of Electrical Engineering 
* The City College of C.U.N.Y. 


ABSTRACT ’ p 

An overshoot suppression scheme to Improve the per- 
formance of the Digital Song Adaptive Delta Modulator 
for picture transmission is described. The overshoot 
suppression algorithm has been verified using computer 
.simulation on a PDP-8. It is also shown that the addi- 
tional hardware required for the actual implementation 
of the algorithm is simpler than those encountered in 
the literature, and gives better signal tracking accuracy. 

I. INTRODUCTION 

Delta Modulation is the name of the encoding pro- 
cess in a Digital Communications Link that allows 
for only changes in the input signal to be processed 
and transmitted. Using this procedure -the link is 
usually required to transmit only one bit 'per sample, 
resulting in an improved bandwidth utilization effi- 
ciency’ over that obtained with PCM systems. 

Briefly, a delta modulator operates as follows. The 
amplitude of the signal to be transmitted is sampled 
periodically and compared to an estimated value. The 
estimated signal is obtained by incrementing the 
previous estimate at each sampling time by a discrete 
amount called a step size. The sign of the difference 
between the signal and its estimate is used to decide 
if the previous estimate should be increased or de- 
creased. This sign information (one bit per sample) is 
also transmitted over the channel to the decoder. The 
decoder uses this bit stream to construct the signal 
estimate, 

A video signal is characterized by discontinuities 
of large amplitude and very short rise time. This cor- 
responds to abrupt changes in shades in the picture 
content. A linear delta modulator is limited in its 
ability to track sudden input changes by its fixed step 
size. The magnitude of the steps is bounded : by the. 
permissible granular noise in constant shade regions,^ 
see Fig la. Shade contrast is thus degraded by the so 
called " slope-overload-noise " introduced by the delta 
modulators inability to rapidly follow the signal dis- 
continuity, To alleviate this condition, while maintain- 
ing the permissible granular noise level, it is desirable 
to make the step sizes small initially but allow them to 
increase quickly In some nonlinear fashion when tracking 
a rapidly varying input, see Tig lb. This is done in an 
adaptive delta modulator 


These effects are shown in Fig 1(b). 

Both the overshoot and the subsequent recovery 
time are undesirable attributes of an adaptive delta 
modulator. Reducing the step sizes decrease the 
possible overshoot amplitudes and shortens the recovery 
time. This, however, augments slope overload. A trade- 
off therefore exists between overshoot amplitude and 
recovery time versus slope-overload-noise in an adap- 
tive delta modulator. v 


Overshoot suppression is a scheme to sharply limit 
the overshoot amplitude and reduce the subsequent re- 
covery time. This is done without reducing the step 
sizes until overshoot is imminent. The trade-off- between 
overshoot amplitude and recovery time versus slope- 
overioad-noise is thus relaxed. 


An overshoot suppression scheme has recently been 
suggested in the literature 3 . This scheme, however 
uses a look-up table in which arbitrary values for the * ' 

step sizes are suggested. It could therefore not serve 
the optimal delta modulator we are investigating in which 
e step sizes are obtained by explicit mathematical ex- ■ 

^ e l Si ° n u' Furthermore > the maximum step size is limited 
in the above scheme by overshoot considerations. How- 
ever in the Song Delta Modulator, the step sizes can 
continually increase with the overshoot suppression 
scheme described below, thus yielding better signal 
to slope-overload-noise ratio. Moreover, the amount of 
equipment Involved In implementing the proposed over- 

tn°tZ SU T eSSl ° n algorithm is vei V mod est in comparison 
the equipment needed to implement other proposed 

C ° Uld fU lnt ° any adQ P tlve delta modulator 
in which the next step size is explicity calculated, It 
s also flexible as to the amount of overshoot suppression 
can perform and trade-offs between conflicting factors 
can be accurately set as may necessary. \ > 

II* VIDE O TRANSMISSION CHARACTERISTIC S OF THE- ■ 

piGIT AL-SONG-VARIABLE-STEP-SIZ R DELTA MODULATOF 


Figure 2 shows the structure of the digitally imple- 
mented optimum adaptive delta modulation system re- 
ferred to In this paper. Briefly, its operation is as 
follows: 


The input signal S(t) is sampled and A to D converted 
to give S k » S k is then compared to its estimate, Xv 
generating a sign-bit e k , with 


The sharp rises in a video signal are usually follow- 
ed by regions of constant level due to regions of uniform 
shade in the picture. Thus while alleviating slope over- 
load problems, an adaptive delta modular introduces the 
possibility of iargo overshoots when the tracked level 
is finally reached. Furthermore, the overshoot is follow- 
ed by a transient oscillatory response until the delta 
modulator finally locks onto the tracked signal level. 

The research presented in this papcrwaiTpartially 
33-§l?-1) d 77 y NASA y fants NGR 33-013-003 and NGR 


e k = sslMS k -\) (i) 

where 

\ “ V, * \ (2) 

ihe step size at the k** 1 sampling instant is 

\ V? < 3 > 

Thus the k step size depends on the previous step size, 
and the previous two sign bits. The g t and g 2 function 
characteristics are shown in Fig 3 i ndicatlng that . 
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where A is the minimum possible step size 
o 


The 


special region/ | A. | < 2 A Q , is needed to prevent a 
dead zone at the origin. The decoder is just the feed- 
back portion of the encoder. It reconstructs the approxi- 
mation X from the e k sign bit stream. Is then D/A 
converted and low pass filtered to give S the es- 
timate of the transmitted signal. 

In video processing, ${t) will contain many large 
discontinuities of very short rise time followed some- 
times by constant levels. Thus edge response is extreme- step sizes 
ly important in video. To permit S (t) to approximate 
rapid rises, i.e,, minimize slope -overload-noise, rapidly 
increasing step sizes are required. This can be accom- 
plished by increasing £, as well as A^ in (4). Gains 
in reducing slope-overload-noise are made at the expense 
of large overshoots and long subsequent recovery times. 

Furthermore, it can be seen in Fig 1(b) that good steady 
state response, i.e., small amplitude oscillations about 


of A and hence X, and Cose (b) is thus trons- 
formed l into a cose (af Situation and the some for (d) 
and (c) respectively. The shape of the modified 
waveform actually depends on the amount by which 
A is decreased. The simplest scheme is one where 
6 k " 1 is replaced by half of its original value. We may 
allo^v for more rapidly increasing step sizes, A^ t i.e., 
larger a and ft (see Eq 4) , as long as A ^ Is replaced 

by a smaller fraction of its original value when over- 
shoot suppression is employed. Thus there Is a faster 
initial rise coupled with a very sharp braking action 
just before the desired level is reached. However, 
since the braking action occurs close to the desired 
.level there is nominal slope overload degradation. 
Indeed, there is an overall decrease. \ n slope overload 
noise due to the more rapid -increase in the initial 


Now the Oveshoot Suppression Algorithm is applied 
to the adaptive delta modulator operating in the Song 
Mode, i.e., a~ 1, £=0.5. It is shown elsewhere 4 that 
usable video transmission can be obtained using these 
parameters even without overshoot suppression. With 
the addition of the suppression algorithm video reprod.uc; 
tion should be much improved* 


a constant level in S(t), requires small A Q . It can also 
be shown that the delta modulator becomes unstable if 
a and /3 are made too large. Thus in choosing a, ft t and 
A Q 3 trade-off must be made between slope overload 
noise versus overshoots, recovery time, and steady 
state response while maintaining delta modulator stabili- 
ty. 

The addition of overshoot suppression to the adaptive 
delta modulator permits n- and £ to be increased while 
decreasing A - In this way, slope overload as well as 
small steady ^tate response requirements can be met 
simultaneously. Impending instabilities due to large a 
and p arc also inhibited and, obviously, overshoots and 
subsequent recovery times are minimised. 


The salient features of the Song Mode response are 
now summarized. In approaching a level from above or 
below as in Fig 4, each step size is K5 times the pre- 
vious one (see Eq 4 for «=l f £=0.51. When a direction 
reversal occurs, as at sampling time It in Fig 4, then the 
first step size following the reversal is one half the 
previous step size, i.e., A =-} A (see Eq 4). Thus, 
in Fig 4(b) we have 


X, 


Vi 




x k- 


k-i 


( 5 ) 


The inequality' sign is needed due to the fixed point 
arithmetic employed in the digital implementation. 


pression algorithm has been implemented. 

Therefore, 

,<V = 

W<V.’' - 


{6) 

Next, set 




■<V 

! = A = ' 4 

k - k-i 


(?) 

Thus 





- w + <v 

”W 

( 8 ) 


Also In Fig 4(b) < S k < X^. To implement over- 

shoot suppression set (A )* ~ -£■ A , where the 
III, THE P RO FO S E D OV E RS HOP T SUP PRC SSI O N_ ALGORITITM pri m ^ refers to the new vafiles after the overshoot sup- 

The Overshoot Suppression Algorithm may be under- 
stood by considering the four cases shown in Fi g 4 in 
which an overshoot or an undershoot occurs. In Fig 4(a) 
an overshoot occurs at sampling time k -1 followed im- 
mediately by an undershoot at k. For this case it is 
easy to show that the delta modulator considered will 
approach its steady-state condition rapidly. This is not 
the case in Fig 4(b) where the overshoot is larger than in 
(a) and X k is greater than S k - Consequently an under- 
shoot occurs at K'H or later and with an amplitude larger 
than in (a). This occurs because the step sizes begin 
increasing again after the first reversed step. Thus it 
will take many more sampling periods to reach steady 
state in (b) than in (a). The algorithm is therefore im- 
plemented only when case (b) occurs. Note that Fig 4(c) 
and 4 (d) depict undershoots corresponding to the over- 
shoots in 4(a) and 4(b) respectively. Action to prevent 
excessive undershoots is thus taken only for case (d). 

The occurrence of cases (b) and (d) can be recognized 
by examining the sequence (e. , 0 , t e. , e^). The 

fingerprint of (b) is (+t, + 1 , -T, - 1 )/ , while that of (d) 
is (- 1 , - 1 , + 1 , + 1 ). Wren either sequence is encountered 
action Is taken to prevent overshoot or undershoot.- 
The corrective action entails decreasing the stored values 


Hence, Fig 4(b) has been transformed into Fig 5, -with 
undershoot occurring at k rather than, k+b or later. It . 
.should be evident from Fig 5 even without a detailed 
explanation of the worst case that the overshoot has 
been at best entirely eliminated or at worst cut in half 
depending on whether S(t) is closer to. (X. )* or X^ 

respectively. Figure 5 also shows that the recovery c 
time is greatly reduced, since the 'delta modulator locks 
onto S(t) very rapidly after Sampling time k. Note aisto 
that now (cr. )' ~ sgn. (S. - (X. )* ) = M, whereas in 
Fig 4(b) ©■« sr- * r ‘ “ * 


■I. 


k ^ - fy “ 

The above overshoot suppression scheme is now 
summarized in the form of an algorithm by considering ^ 
e typical cycle of the now modified delta modulator. 
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Step 1: Generate S, 

Step 2: Calculate | <V,’ 

Sttfp 3: Calculate ■* X^_ + ^ 

Step 4: Calculate e = sgn,(S, - XJ and transmit 
this bit. * 

In the delta modulator without over shoot sup- 
pression this would complete the cycle. That is, 
k is next updated and steps through 4 are repeated. 
To implement overshoot suppression the following 
additional steps are needed. 


Step 5: If e t = e, = + 1, and e. =e =-l,setV=l. 

K"3 K-g K “l * 

If e. =e. - -l, and e. =e = l,set W=l. 
k- 3 k- 2 k- t k 

Step 6: If \# 1 and W& go to 7, otherwise set 

• < a > V, 

< b > (W =} S 

(C) (\) ' - \ 

(d) (V =p< k _ i ) , + (^> , =x k _ 2 

(e) (gJ *=-e k 

Step 7: Update k. That is, set e. * e. ; 

e =e. : If step 6 is exe&uted ~<£ )‘ » 

oterwis^ e. “ e , etc. 1 

K — j, K 

IV. HARDWARE I MPLEMENTATION CP THE OVER 

SHOOT SUPPRE SS ION ALGORITHM , ■ S 

■ The implementation cf the above overshoot sup- c 
pres sion algorithm requires the addition of very lit- 
tle hardware to the Digital Song Adaptive Delta Mo- 
dulator. This can be seen by considering the sche- 
matic representation of the delta modulator CODEC 
(Coder-Decoder- Combination) with overshoot sup- 
pression shown in Fig. 2. Note that the extra com- 
ponents needed to implement the suppression scheme 
appear in branches that are drawn with dashed lines. 
Of these, the only major devices are the delay ele- 
ments D5,DG, and the adder A4. However, since the 
adders A1,A2, and A3 are really. one time- shared 
adder, we can easily time- share adder A4 also. The 
remaining extra elements are only a few gates needed 
for decision, switching, ami timing purposes. Mote 
that the execution of step G(a) of the algorithm ,(A^ )' 
= fA , need not require the addition of any explicit 
hardware. We merely read into adder A4 the contents 
of the A register shifted by one bit, thereby result- 
ing J.n a division by two. 


It is difficult to discern the operation of the cir- 
cuit by merely examining the schematic diagram in 
Fig. 2 because the sequential order of operations is not 
not specified in tte diagram. However, the actual ope- 
ration is made clear by considering Fig. 2 in conjunc- 
tion with, the seven steps of the overshoot suppres- 
sion algorithm. 


The additional steps c£ the algorithm place an 
added requirement on the logic speed. After the com- 
pletion of a normal cycle of the delta modulator, ex- 
tra Urne is needed to perform two more additions and 
the various logic operations needed to rearrange tho 
internal values, Mo problem will arise if this can be 
done in one sampling period, If it cannot, then either 
the sampling rate must.be decreased, or logic com- 
ponents capable of higher switching speed must be 
used. 

At this point, it should be pointed out that a signi- 


ficant simplification is possible in the encoder Implemen- 
tation. Namely, Step 6(b) and hence Step 6(a) do not 
have to be explicitly executed in the encoder because 
(X^,) 1 is not really needed to compute Of*} 1 in Step 6fdl, 
i.e . 1 is simply replaced by . which is available in the 

memory. Furthermore, it is easy to snow that (X^_ )* is 
not used in later cycles due to the fact that once in over- 
shoot is suppressed at k-1, the earliest future time for 
implementing the algorithm is at k+2. By this time 
is clocked out of the memory. In terms of hardware sav- 
ings in the encoder, this eliminates the gates needed to 
produce (A )' = { A t as well as A4 and A2 to cany 
out Steps C(B) and 6 (cf) Respectively. These simplifica- 
tions are not possible in the decoder because its output 


with overshoot suppression, has to be taken from 
rather than from X. . Note that If the output was taken 1 
from X,, then the overshoot suppression produced by 
going Back in time and reducing X ^ would not be evi- 
dent in the output S (t)< 1 


V. COMPUTER SIMULATIONS 

The Digital Song Delta Modulator, with andwithout 
overshoot suppression, was simulated on a PDP-8 com- 
puter. The minimum step size used ( A 0 ) was normalized 
to unity. The dynamic range was 0 to 2024 , This cor- 

responds to a ten bit internal arithmetic in an actual 
hardware implementation. 


The responses of the delta modulator to step fun- 
ctions of different amplitudes,, with and without overshoot 
suppression, appear in Fig. 6. Figs. 6(a), aid 6(b) exhibit 
large overshoots and sustained oscillations. They corres- 
pond to the sequence = 1, e. 1, where 

k-1 is the sampling time &hen overshoot 1 occurs. Figs. 
6(a'), and6(b') are the same waveforms but with over- 
shoot suppression. As an example, compare Figs. 6(a) 
and 6{a'). Here the maximum peak-to-peak oscillations 
are reduced from 22 A to 9^ 0 4 Similar observations can be 
made for Figs. 6(b) and G(b'). Furthermore, here the settl- 
ing time to the steady state is reduced from six to three 
sampling periods. 


While Fig. 6 gives a good indication of the general 
nature of the improvement, due to overshoot suppression, 
a more convincing illustration is depicted in Fig. 7 where 
the discontinuities are much larger. Note that the appa- 
rent slow rise times in Fig .7 are due to tta compression 
produced by a scaling factor of 0. 1 used in the plotting. k 
In reality Fig. 7 rises oj er a range of 5 000 A in only 13 
sampling periods. To achieve the same amplitude, a non- 
cidaplive delta modulator would require 500 sampling 
periods. 


Briefly, tho 3alient features of the response are as 
follows: The rise tine to reach a given level is the same 
with or without overshoot suppression. Overshoots are 
suppressed by a minimum of 50%. Recovery times follow- 
ing overshoots are significantly reduced as seen in Fig .7b, 
The data plotted in Fig. 7 is given in Table 1 for quantita- 
tive comparisons. The peak-to-peak amplitude of tlie stea- 
dy state response is three times the minimum step size 
for either scheme. The period of steady state oscillations 
is 4 sampling periods without overshoot suppression, and 
3 sampling periods with overshoot suppression. In either 
case, tho peak-to-peak steady state oscillation amplitu- 
des are smaller than a grey level in the picture waveform. 
Thus constant shade regions will not suffer significant 
degradation. 


6D-3 



r«r:nt)r,n 


rJtrAWfW, 




This is based on tho assumption of quantising a pixel 
into G'4 groy levels with a total dynamic rongo of 1021 A 

VI. CONCLUSIONS 


An overshoot suppression algorithm has been prop- 
osed and verified by computer simulation. It has been 
shown that the scheme significantly improves the 
transient behavior of video waveforms transmitted 
using delta modulation techniques. 

The main advantages of the proposed algorithm are: 

(a) It can be easily utilized in optimal digital del- 
ta modulators that can be described by a closed 
-form mathematical formulation and in partic- 
ular in the Adaptive Song Delta Modulator* 

(b) The scheme has rather modest requirements for 
hardware implementation, . 

(c) It allows for flexible trade-off between slope- 
overload and overshoot noise. 




np. t Dor.o -Adapts.- Doltc Modulator with provl.lorii tot Ov«rihool frjf>ti«**ion. (ria thod brand*. 

for OvarrfvxA fjupprosmlan.} 


Therefore, the addition of the overshoot suppress- 
ion algorithm significantly improves the performance of 
the digital delta modulator for picture transmission. 
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.000 

XKT“ 

1 .000 

K» 

4.000 

SK® 

500.5 

XK® 

1 5-00 

xk i;® 

I . ooo 

EKT® 

1.000 

K" 

5-000 

SK® 

50 0.5 

XK® 

24.0 0 

KKIJ" 

.000 

KKT- 

1.000 

K® 

6-00O 

SK* 

500*5 

XK® 

37.00 

F.K 17“ 

.000 

EK7- 

1 .000 

X® 

7-000 

SK® 

500.5 

XKn 

56*00 

EKU- 

.000 

EKT» 

1.000 

K« 

8.000 

SK® 

500*5 

XK® 

C 4 » O A 

EX II® 

1.000 

EKT« 

I .000 

Kb 

9.000 

SK® 

500*5 

XK® 

J 26.0 

EKU® 

1*000 

EKT" 

1 .000 

H" 

10.00 

SK® 

500 • 5 

XK® 

109*0 

EKTl® 

.000 

EKT- 

1-000 

K= 

11.00 

SK® 

500*5 

XK« 

20 3*0 

KKU® 

.000 

EKT- 

1 .003 

K= 

12.00 

SK® 

son . 5 

XK® 

424*0 

EKU* 

.000 

EKT® 

1.000 

K® 

1 3.00 

SK® 

500.5 

XK® 

529.0 

■ EKU® - 

.000 

EKT- - 

] .000 

K® 

14.00 

SK" 

500-5 

XK® 

424-0 

EKU® 

.000 

EKT-- 

1 . 000 

K" 

1 5-00 

SK® 

son . 5 

XK** 

476*0 

EKU® 

*000 

EKT« 

1 , 003 

K- 

16-00 

SK® 

500 - 5 

XK® 

515.0 

EKU® - 

.000 

EKT«- 

1 .003 

K« 

17.00 

SK® 

500.5 

XX® 

476.0 

EKU® 

.000 

KKT® “ 

1.000 

K- 

IQ. 00 

SK® 

500-5 

XK® 

496.0 

EKU® 

.000 

EXT- 

1 .000 

K“ 

19-00 

SK® 

50O.5 

XK® 

509.0 

EKU® - 

.000 ■ 

EKT— 

1 .000 

K« 

2(3.00 

SK® 

500*5 

XK® 

495*0 

' EKU® 

.000 

KKT=- 

1 .000 

i<® 

21.00 

$K* 

500 * 5 

XK® 

502.0 

EKU® ® 

*mm 

EKT®- 

I .000 

K® 

22.00 

SK® 

5M0.5 

XK” 

499.0 

KKU® 

.003 

EKT- 

i .o m 

K® 

23.00 

SK- 

500,5 

XX® 

50« .0 

KKU® 

.000 

EKT- 

1 .000 

K® 

24.00 

SK® 

500-5 

XK® 

501.0 

EKU®- 

*000 

EKT" “ 

i .000 

K® 

25.00 

SK* 5 

500.5 

XK® 

500 . 0 

KKU® 

! .000 

EKT»- 

1 .000 

K® 

26-00 

SK® 

300.5 

XKo 

50 2*0 

EKU® - 

1 .000 

EKT«- 

1 .000 

K« 

27.00 

SK® 

300. 5 

XK® 

50 J . Ci 

EKU*- 

! .000 

. EKT—* 

l - one 

K« 

28*00 

SK® 

300*5 

XK® 

499-0 

KKU® - 

! .000 

KKT*»* 

1 .000 

K« 

29.00 

SK" 

300.6 

XK® 

496*0 

KK U« - 

.000 

EKT-" 

1.000 

K« 

30.00 

SK® 

300-5 

XK® 

492-0 

EKU® - 

! .000 

EKT«* 

1 .000 

K- 

31.00 

SK® 

f MOO. 5 

XK® 

486*0 

EKIJ® - 

1 .000 

KKT"- 

f ,000 

K“ 

32-00 

• SK® 

300-5 

XX® 

47 7.0 

. EKU® - 

! .000 

ekt»- 

1 .000 

X® 

33*03 

sx® 

300*5 

XK® 

464.0 

EKU=- 

1 .000 

EKT- - 

1 .000 

K® 

34*00 

SK® 

300. S 

XK= 

445.0 

EKU® - 

i .000 

EKT— 

i .000 

X® 

35.00 

SK» 

300, 5 

XK® 

417.0 

EKU® - 

! .003 

EKT“- 

1 .000 

K® 

36.00 

SK" 

300. 5 

XK® 

975.0 

EKU®- 

; .000 

EKT«- 

1 ► 000 

K® 

37.00 

SK® 

300.5 

XK® ‘ 

‘312*0 

EKU-- 

! .000 

EKT— 

1 .000 

K® 

38.00 

SK® 

300*5 

XK®, 

265*0 

EKU® 

i .000 

EKT= 

1 .000 

K- 

39-00 

SK' 5 

300 . 5 

XK® 

312*0 

EK U® - 

; .fjoo 

EKT® 

1.000 

K- 

40-00 

• SK® 

300 * 5 

XK® 

289*0 

KKU® 

; .ooo 

EKT « 

1 .000 

X® 

4 1 . 150 

SK® 

300.5 

XK® 

300.0 

EKU® 

1 .000 

EKT® 

1 .000 

X® 

42. 00 

SK® 

300. 5 

XKr 

308-0 

EKU® - 

1 .000 

EKT" - 

1 .000 

K° 

43.00 

SK® 

300.5 

XK® 

300*0 

EKU® 

: .000 

EKT— 

1 .000 

K« 

44.00 

SK® 

300.5 

XX® 

3044 0 

EKU®- 

i -000 

EKT® - 

1 .00(5 

K= 

4$, 00 

SK" 

30 R * 5 

XK® 

302*0 

EKU® - 

1 .000 

i;k t- - 

1 *000 

K* 

46.00 

SK® 

300-5 

XK® 

30 1.0 

EKU® 

, .000 

EKT a 

1 *000 

K- 

47.00 

SK® 

300-5 

XK® 

302.0 

EKU- " 

.000 

EKT® 

1 .000 

K® 

48-03 

SK® 

200.5 

XK“ 

3R0.0 

EKU a 

1 .030 

EKT« 

I *000 

K- 

49.00 

SK® 

300 . 5 

XK® 

301.0 

EKUr- 

. 000 

EKT®- 

1 *OG0 


Tab le l fb^ Table of values for Fig. 7{b) 

EKU ~ sign bit uaed inside encoder and decoder. 
EKT =■* eign bit transmitted from encoder to decoder. 
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